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SUNNMV 


This  paptr  dsscribat  tha  davalopMnt  of  Officer  Screealng  Coaposites  (OSCs),  designed  to 
assist  Air  Force  test  adalnistrators  and  recruiters  In  obtaining  a  quick  and  accurate  estlaate  of 
applicants'  aptitude  scores  on  the  Air  Force  Officer  Qualifying  Test  (AFOQT).  Fora  0.  Scoring  of 
AFOQT'O  Is  centralized,  causing  a  I-  to  2-week  delay  before  official  test  results  on  applicants 
are  available  to  recruiters.  The  delay  slows  processing  of  applicants  and  way  have  a  negative 
lapact  on  the  officer  recruiting  capability  since  potential  recruits  aay  seek  other  eaployaent 
opportunities.  The  OSC  procedure  was  needed  to  help  recruiters  prescreen  applicants  and  to 
expedite  the  processing  of  candidates  with  a  high  likelihood  of  aeetlng  aptitude  requireaents  for 
coaalsslonlng.  The  OSCs  consist  of  abbreviated  versions  of  the  five  coaposltes  on  AFOQT-0: 
Pilot,  Navigator-Technical,  Acadealc  Aptitude,  Verbal,  and  Quantitative.  Subsets  of  Iteas  In 
AFOQT-0  were  selected  for  separate  scoring  as  the  OSCs.  The  scores  on  OSC  Iteas  were  validated 
using  a  saaple  of  37,409  applicants.  The  results  Indicated  that  applicants'  scores  on  the  OSCs 
were  highly  correlated  with  their  official  scores  on  the  AFOQT-0  coaposltes.  The  OSC  procedure 
provides  an  accurate  and  efficient  Indicator  of  test  perforaance  on  AFOQT-O  and  Is  a  valid  tool 
for  recruiters  to  use  In  prescreening  officer  applicants.  To  help  recruiters  apply  the  OSC 
procedure,  five  tables— one  for  each  coaposite— were  developed  to  show  the  conversion  of  OSC  raw 
scores  to  expected  AFOQT-O  percentile  scores.  It  Is  recoaaended  that  the  OSC  aeasures  be 
lapleaented  at  all  AFOQT-O  testing  sites. 


PREFACE 


This  work  mm  conducttd  und«r  Task  7719tft,  Personnel  Qualifications  Test,  Mhich  Is 
part  of  a  larger  effort  In  Force  Acquisition  and  Distribution  Systess.  It  was  started 
under  uork  unit  77191819,  Officer  Selection  and  Classification  Measures,  and  uas 
coapleted  under  Mork  unit  77191847,  OevelopMnt  and  Validation  of  Civilian  and  Nonrated 
Officer  Selection  Methodologies. 
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SCREENING  CONPOSITES  FOR  AIR  FORCE  OFFICERS 


1.  INTRODUCTION 

Tht  Air  Foret.  Ilkt  othtr  organizations,  is  concerned  with  selection  of  qualified  Individuals 
to  fill  Jobs.  Identifying  Individuals  aost  likely  to  be  successful  In  training  and  on  the  Job  Is 
the  ultiMte  goal  of  the  selection  and  classification  process. 

To  aid  In  selection,  the  Air  Force  currently  eaploys  two  aajor  aptitude  tests.  The  first 
test,  the  Air  Force  Officer  Qualifying  Test  (AFOQT).  Is  given  to  those  Individuals  applying  for  a 
eoaalsslon  (Rogers  A  Roach.  In  press).  The  second  test  used  for  selection  Is  the  Araed  Services 
Vocational  Aptitude  Battery  (ASVAB).  This  test  Is  used  by  all  of  the  alHtary  services  to  select 
enlisted  aeabers  for  duty  (Ree,  Mathews,  Mullins.  A  Massey,  1982).  In  order  to  reduce  costs 
associated  with  processing  applicants,  prescreening  of  the  applicants  Is  necessary.  The 
Enllstaent  Screening  Test  Is  currently  used  for  prescreening  with  the  ASVAB  (Mathews  A  Ree, 
1982):  however,  there  Is  no  corresponding  Instruaent  for  use  with  the  AFOQT. 

In  the  past  several  prescreening  tests  have  been  associated  with  the  AFOQT.  The  Air  Force 
Precoaalssloning  Screening  Test  (AFPST)  was  developed  to  screen  applicants  for  navigator  training 
and  to  select  applicants  for  the  Air  Force  Acadeay  Preparatory  School  (Valentine,  1961).  This 
test  was  a  shortened  version  of  the  Officer  Quality  coaposlte  (now  referred  to  at  the  Acadealc 
Aptitude  coaposlte),  one  of  the  five  coapotites  that  aake  up  the  AFOQT.  The  AFPST  was  revised 
and  lapleaented  In  1965  (Miller,  1966),  and  renaaed  the  Pre-Enrollaent  Test.  Miller  (1968) 
revised  the  Pre-Enrollaent  Test  again  In  1967.  Both  the  Air  Force  Precoaalssloning  Screening 
Test  and  the  Pre-Enrollaent  Test  were  designed  to  predict  perforaance  on  the  AFOQT.  The 
Pre-Enrollaent  Test,  however,  was  discontinued  In  April  1969,  leaving  recruiters  without  a 
prescreening  device  for  officer  applicants. 

A  need  for  a  prescreening  device  to  be  used  In  conjunction  with  the  current  operational  fora 
of  the  AFOQT  (Fora  0)  surfaced  again  In  July  1982.  The  purpose  of  this  effort  was  to  develop  a 
tool  to  aid  recruiters  In  Identifying  those  applicants  for  Officer  Training  School  (OTS)  who  are 
aost  likely  to  succeed  on  AFOQT-O. 


II.  METHOD 


Itea  Selection  for  the  Officer  Screening  Coaposites  (OSC) 

The  new  prescreening  device,  referred  to  as  the  Officer  Screening  Coaposites  (OSCs),  was 
designed  to  be  an  Integral  part  of  AFOQT-O,  thus  avoiding  the  developaent  of  a  separate  test. 
The  AFOQT  Is  currently  aachine-scored  at  a  central  location.  Scoring  turnaround  tiae  Is  7  to  9 
days  for  the  recruiters.  The  OSCs  can  be  handscored  by  qualified  test  adalnlstrators,  giving  the 
recruiters  an  laaedlate  Indication  of  the  Individual's  probable  ability  on  the  AFOQT  as  a  whole. 
This  feedback  will  allow  the  recruiters  the  advantage  of  aore  tiaely  scheduling  of  processing 
activities.  To  accoapllsh  this  goal,  five  subsets  of  Iteas  froa  the  operational  adalnistratlon 
of  the  AFOQT  were  scored  separately.  These  subsets  approx laated  the  content  of  the  five  AFOQT 
coapotites:  Pilot,  Navigator-Technical,  Acadealc  Aptitude,  Verbal,  and  Quantitative. 

The  AFOQT  contains  16  subtosts  which  aake  up  the  five  coaposites  (soae  subtests  are  used  In 
aore  than  one  coaposlte).  OSC  aeasuret  were  developed  to  correspond  with  each  AFOQT  coaposlte, 
by  selecting  Iteas  froa  subtests  In  the  coaposlte.  However,  there  were  two  OSC  aeasuret 
developed  for  the  AFOQT  Navigator-Technical  coaposlte:  one  with  Quantitative  Iteas  (OSC-N,) 
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X. 


and  ona  Mithout  (OSC'N).  Both  Mtrt  gonaratad  to  coapara  thair  pradictiva  ability.  If  tha  OSC-N 
pradictad  at  wall  as  did  tha  OSC-N,,  It  would  ba  usad  In  tha  final  product  bacauso  of  having 
fawar  Itaas  to  ba  scorad.  Tha  OSC  ■aasures  ara  rafarrad  to  at  Officer  Screening  Coapotite-Pllot 
(OSC-P),  Officer  Screening  Cowpotlta-Navlgator  (OSC-N),  Officer  Screening  Coapot1ta-N, 
(OSC-N,),  Officer  Screening  Coaposita-Acadaalc  Aptitude  (OSC-A),  Officer  Screening 
Coapotlta-Varbal  (OSC-V),  and  Officer  Screening  Coaposlte-Quantltatlve  (OSC-Q). 

Candidate  Itau  for  the  screening  coaposltat  ware  Identified  prlnarlly  by  Inspecting  1te« 
correlation  statistics.  The  final  content  of  tha  screening  conposltas  In  terns  of  AFOQT  subtests 
and  nunbar  of  Itans  It  shown  In  Table  1.  Itans  selected  for  OSC-P  and  OSC-N  had  high  bisarlal 
correlations  with  tha  corresponding  AFOQT  conposita  raw  score.  As  shown  In  Table  1,  not  all 
subtasts  In  tha  AFOQT  Pilot  and  Navigator-Technical  conposltas  ware  reprasentad  In  OSC-P  and 
OSC-N.  Tha  second  Navigator-Technical  screening  conposita,  N,,  contained  the  sane  Itans  used 
In  OSC-N  plus  those  usad  In  OSC-Q.  Itans  for  OSC-Q  ware  salactad  on  the  basis  of  high  bisarlal 
correlations  with  raw  scores  on  tha  subtasts  which  nake  up  the  AFOQT  Quantitative  conposita.  The 
sane  procedure  was  followed  to  select  Itans  for  OSC-V.  OSC-A  was  forned  by  conblning  tha  Itens 
In  OSC-Q  and  OSC-V. 


Table  1.  Content  of  OSC 


• 

■"SI 

AFOQT-O  Subtest 

OSC-P 

OSC-N 

Nunber 

OSC-N, 

Of  Itens 

OSC-A 

OSC-V 

OSC-Q 

h*  j 

i*. 

Verbal  Analogies 

- 

6 

6 

.* ' 

Arlthnetic  Reasoning 

an 

7 

7 

7 

Reading  Conprehenslon 

7 

7 

Data  Interpretatlen 

- 

6 

6 

6 

i 

Mord  Knowledge 

7 

7 

F 

Nath  Knowledge 

- 

7 

7 

7 

'  « 

[ 

Nechanical  Conprehenslon 

2 

- 

- 

1 

Electrical  Naze 

4 

- 

- 

•  x 

Scale  Reading 

- 

3 

3 

Instrunent  Conprehenslon 

S 

irtndl 

■ 

Block  Counting 

IS 

12 

12 

Table  Reading 

11 

IS 

IS 

Aviation  Infornatlon 

- 

.  _  . 

Rotated  Blocks 

8 

8 

General  Science 

2 

2 

Hidden  Figures 

- 

- 

Note:  Dash  (-)  Indicates  those  subtests  which  are  represented  In  the  corresponding 
full  conposlte  but  not  the  screening  conposita. 


Subjects 

The  OSC  validation  sanple  consisted  of  Individuals  taking  AFOQT-0.  A  total  sanple  of  37,409 
was  used.  Conpositlon  of  the  total  sanple  Is  described  In  Table  2. 


.  ■  .  m  •  M  nl-  < 
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Table  2.  Distribution  of  tho  Sauple 


Subgroup 

N 

Source 

of  Couulsslon 

OTS 

30,465 

AFROTC 

6,944 

Sex 

Male 

32,742 

Feuale 

4,503 

Unknown 

164 

Race 

Auerlcan  Indian  or  Alaskan  Native 

354 

Aslan  or  Pacific  Islander 

1,004 

Black,  but  not  of  Hispanic  Origin 

4,958 

Hispanic 

1,678 

White,  but  not  of  Hispanic  Origin 

29,261 

Unknown 

154 

Procedure 

A  Pearson  product-uouent  correlation  was  couputed  betueen  each  of  the  five  AFOQT  couposites 
and  each  OSC  for  the  total  group.  Distributions  were  also  obtained  for  each  scoring  Increuent  of 
the  OSC  versus  the  z-score  uean  and  standard  deviation  (SO)  for  a  90S  confidence  Interval  (z  ■ 
Moan  ^  1.64S  SO),  a  9SS  confidence  Interval  (z  *  Mean  ^  1.96  $0),  and  a  99S  confidence  Interval 
(z  «  Mean  *  2. SO  SO). 


III.  RESULTS  AND  DISCUSSION 

Because  the  OSCs  are  a  subset  of  the  AFOQT,  the  correlations  between  each  AFOQT  couposite  and 
the  corresponding  OSC  score  were  high  (see  Table  3).  The  Navigator-Technical  couposite  correlated 
higher  with  OSC-N,  than  It  did  with  OSC-N.  The  reason  Is  that  the  AFOQT  Navigator-Technical 
couposite  and  OSC-N,  both  Include  Quantitative  Iteus. 


Table  3.  Correlation  Between  OSC  and  AFOQT-O  Couposites 


AFOQT  Couposites 

OSC-P 

OSC-N 

OSC-N, 

OSC-A 

OSC-V 

OSC-Q 

Pilot 

.892* 

.853* 

.873* 

.721* 

.581* 

.702* 

Navigator-Technical 

.849* 

.868* 

.942* 

.790* 

.583* 

.831* 

Acadeulc  Aptitude 

.602* 

.632* 

.789* 

.964* 

.874* 

.827* 

Verbal 

.468* 

.488* 

.583* 

.884* 

.953* 

.582* 

Quantitative 

.631* 

.666* 

.862* 

.854* 

.598* 

.937* 

^Significant  at  the  .001  level.  Correlations  between  each  OSC  and  Its  corresponding 


AFOQT  score  are  underlined. 
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The  distributions  of  z  provided  In  the  tables  can  be  used  to  convert  a  given  OSC  raw  score  to 
the  expected  AFOQT'O  percentile  score  for  a  particular  conposite.  The  percentile  score  range  of 
the  confidence  Intervals  was,  of  course,  wider  for  the  99t  confidence  Interval  and  narrower  for 
the  90S  confidence  Interval.  Because  this  Is  to  be  a  workable  tool  for  the  recruiters,  the  90S 
confidence  Interval  was  chosen  to  develop  the  conversion  tables  for  the  OSC  (see  Appendix). 

The  expected  AF0QT«0  percentile  score  that  corresponds  to  each  OSC  raw  score  was  computed  by 
finding  the  median  of  each  confidence  Interval.  These  scores  accompanied  by  the  confidence 
Intervals  provide  recruiters  with  a  workable  tool  for  predicting  success  on  the  AFOQT. 


IV.  CONCLUSIONS  AND  RECONNENDATIONS 

OSC  scores  are  effective  predictors  of  test  performance  on  AFOQT-O,  as  Indicated  by  their 
high  positive  correlations  with  AFOQT  composite  scores.  The  OSC  provides  recruiters  with  an 
efficient  and  valid  tool  for  prescreening  and  managing  applicants.  Using  OSC  results  recruiters 
can  make  sound  Judgments  about  the  advisability  of  continuing  to  process  an  applicant  while 
waiting  to  receive  official  AF0QT«0  scores. 

Analysis  results  support  the  following  conclusions. 

1.  Recruiters  can  place  a  high  degree  of  confidence  In  the  prescreening  procedure.  On  any 
single  composite,  the  expected  AF0QT«0  percentile  score  will  fall  within  the  score  Interval 
provided  In  the  conversion  table  for  at  least  90%  of  the  applicants  whose  tests  are  scored  using 
the  corresponding  OSC. 

2.  Recruiters  can  use  the  OSC  to  rank«order  applicants  from  highest  to  lowest  predicted 
AFOQT-O  scores.  The  results  provide  the  opportunity  for  applicant  resources  to  be  managed  more 
effectively:  recruiters  can  expedite  the  processing  of  high-ranking  applicants  who  are  most 
likely  to  meet  Air  Force  aptitude  entry  requirements. 

3.  Although  OSC  scores  were  originally  designed  to  aid  recruiters  who  process  applicants 
for  OTS,  they  can  also  be  used  effectively  by  test  administrators  at  Reserve  Officer  Training 
Corps  (ROTO  detachments. 

It  Is  recommended  that  the  OSC  measures  be  Implemented  at  all  AFOQT-O  testing  sites. 
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APPENDIX:  OFFICER  SCREENING  COMPOSITE  TABLES 


Tabit  A-1.  Convarslon  Tabic  Officer  Screening  Coeposltc  •  P 


Expected 

Expected  Percentile 

OSC-P 

AFOQT-0  Pilot 

Score  Range 

Raw  Score 

Coeposlte  Percentile 

(90t  Cl) 

Tibit  A>2  (concluded) 


0SC«N, 

Raw  Score 

Expected 

AFOQT^O  NevTech 
Coaposlte  Percentile 

Expected  Percentile 
Score  Range 
(90S  Cl) 

38 

43 

25 

•  62 

39 

46 

28 

*  65 

40 

49 

30 

•  68 

41 

52 

33 

-  72 

42 

55 

37 

-  73 

43 

59 

41 

-  77 

44 

61 

42 

•  81 

45 

64 

47 

•  82 

46 

68 

50 

-  87 

47 

71 

55 

.  88 

48 

72 

58 

•  90 

49 

77 

62 

•  93 

SO 

80 

65 

•  95 

51 

83 

70 

-  96 

52 

85 

73 

-  97 

53 

87 

77 

•  98 

54 

90 

81 

«  99 

55 

91 

83 

-  99 

56 

93 

88 

-  99 

57 

94 

90 

•  99 

58 

95 

9) 

•  99 

59 

97 

95 

-  99 

60 

98 

97 

-  99 

(• 
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Tabit  A-3.  Convcrtloii  Table  Officer  ScreeelRt  Coaieoafte  •  A 


Tiblt  A-4.  Convtrsfon  Table  Officer  Screening  Coeposite  •  V 


OSC-V 
Rae  Score 


Expected 
AFOQT-O  Verbal 
Coepoalte  Percentile 


04 

05 

07 

00 

II 

14 

19 

22 

26 

30 

34 

39 

44 

49 


Expected  Percentile 
Score  Range 
(90t  Cl) 


01  •  08 
01  -  TO 
01  -  13 
02  •  IS 
03  •  19 


T«blt  A-5.  Conversion  Ttbit  Officer  Screening  Coaposlte  -  Q 


